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METHOD AND DEVICE TO IDENTIFY A PERIODIC LIGHT SOURCE 

BACKGROUND OF THE INVENTION 
Field Of The Invention 

[0QQ1] This invention relates generally to devices for location 
positioning and more particularly relates to a method for 
5 identifying an environmental source emitting a base frequency and 
waveform signal. 

[00021 The present invention also relates to a system for 
performing the method and a computer program for performing the 
method. 

10 

Description Of The Related Art 

[QQ03] In various modern applications, it is essential for a 
device to know its location. Usually it suffices to know the room 
in which the device is located. This allows the application to be 

15 tailored to the location of a user of the device. This way, a so- 
called context-aware device is capable of adjusting its operations 
to fit the context in which the device is introduced. Context is 
any information that can be used to characterize the situation of 
an entity. An entity is a person, place, or object that is 

2 0 considered relevant to the interaction between a user and an 

application, including the user and application themselves. Almost 
any information available at the time of an interaction can be seen 
as context information. Some examples are: 
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• spatial information - e.g.^ location, orientation, speed, 
and acceleration^ 

• environmental information - e.g.j_ temperature, air 
pressure, light, and noise levelj_ 

• resources that are nearby - e.g.^ accessible devices, and 
hosts_L 

• availability of resources - e.g.^_ battery, display, 
network, and bandwidth ; and 

• physiological measurements - e.g.j_ blood pressure, heart 
rate, respiration rate, and muscle activity. 

[0004] A system is context-aware if it can extract, interpret 
and use context information and adapt its functionality to the 
current context of use. The challenge for such systems lies in the 
complexity of capturing, representing and processing contextual 
data. To capture context information^ generally^ some additional 
sensors and/or programs are required. To transfer the context 
information to applications and for different applications to be 
able to use the same context information^ a common representation 
format for such information should exist. In addition^ to being 
able to obtain the context-information, applications must include 
some 11 intelligence 11 to process the information and to deduce the 
meaning. This is probably the most challenging issue, since context 
is often indirect or deducible by combining different pieces of 
context information. E.g.^ if three persons meet in a certain 
office room at a certain time, it can mean that it is the weekly 
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strategy meeting. Another situation would be when a context-aware 
application, such as a context-aware mobile phone, is placed in 
front of the user's personal computer at work, the application 
could then be given the information that the user do not wish to be 
disturbed with private phone calls. 

[0005] There are features that are characteristic for context- 
aware applications. Firstly, information and services can be 
presented to the user according to the current context. This 
includes the selection of proximate information and services, and 
contextual commands. Secondly, automatic execution of a service may 
be performed when being in a certain context. This includes 
context- triggered actions and contextual adaptation. An example of 
the previous would be that when a user enters a specific room^ 
his/ her mails would be shown on a nearby terminal. An example of 
the latter would be the change on volume on a phone according to a 
current noise level. 

[QQ061 A very evident type of application is the ability to find 
nearby resources. This can include input and output devices: 
printers, displays, speakers, facsimiles, video cameras, 
thermostats, etc. In pure service lookup^ actually even no location 
information needs to be used. In situations where^ e.g.^ distance 
calculations have to be done^_ location information of a device is 
required. 

[0007] The usage of context information is still quite limited 
since it is very challenging and complex to capture, represent, and 



PHNL020974-SS-RED-110407 .doc 2 



PHNL 020974 



process contextual data. The most used types of context information 
are location, identity and time information. The context-aware 
application development is mainly concentrated around user 
interfaces, virtual and augmented reality, mobile, handheld and 
wearable computing. There are very few commercial products using 
context information yet, because of the challenges in this field. 
[0008] There are several ways to obtain required location 
information. A variety of tracking systems exists, some of them 
based on the Global Positioning System (GPS) with which the 
location of a device can be determined. Systems for a positioning 
network^ such as the GPS— kr , are known for the purpose to locate 
virtually any place on the planet-7 — h - ew e v e- r . However , such tracking 
systems are quite expensive which makes them unacceptable for low- 
cost consumer electronics. Other solutions involve the installation 
of positioning devices^ such as GSM, DECT or Bluetooth beacons, 
etc. Furthermore it is known to adapt existing devices to act as 
sources of position information. 

[QQ091 A lighting source can be modified to operate at a 
specific known frequency-;- which can be detected by a device and 
translated to a location. U.S . Patent 5,657,145 discloses a method 
of transmitting coded data signals by modulating the output from 
light sources, e.g.^ electric lamps. The visible light wave is used 
as a carrier wave whereon the signals are transmitted. A wide range 
of digital information can be transmitted^ such as audio and video 
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content, etc. Of course, this modulation can also be used to 
identify the light source. 

[00101 However, the light sources have to be modified to 
transmit the requested information and thereby be identified. It 
will^ though^ be advantageous not to modify ambient light sources 
for several reasons. 

S SUMMARY OF THE INVENTION 
[00111 It is an object of the invention to provide a method for 
location positioning of a device without the need for modifying 
environmental sources . 

.15 0121 It is further an object of the invention to provide a 
method for storing location parameters, which may be recovered for 
further processing. 

[QQ131 This is achieved by a method (and corresponding device) 
for identifying an environmental source emitting a base frequency 
and waveform signal, the method comprising the steps of measuring 
the waveform signal of the source in a predetermined time-interval; 
estimating a the emitted waveform characteristic of the measured 
waveform signal; and determining a number of actions based on the 
estimated characteristic. 

[0014] By omitting environmental source modifications, a 
positioning device according to the present invention may be more 
consumer-oriented, cause the lack of operational precautions. It 
may therefore be possible to quickly adapt a device according to 
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the method of the present invention to a new environment without 
the need of installing sophisticated hardware. Therefore, the 
method of the present invention deals with recognizing 
environmental sources by their natural signal pattern without 
introducing a new pattern by artificial modulation. 
[0015] Further, the method according to the present invention 
proposes to identify a "fingerprint" of an environmental source, 
e.g.^. a light source, and to store this fingerprint, which^_ in an 
embodiment of the invention^ is a waveform of a light intensity, in 
memory. The fingerprint can then be used tOj_ e.g..,., determine that 
the device has been in a given location before by use of 
information affiliated with data of the fingerprint. The affiliated 
information may be instructions to execute a number of actions, 
e.g.^ user notification, external device controlling, data 
acquisition, etc. If light sources are operating periodically^ 
i.e.^ a source is fed by AC-voltage, not only the light intensity 
may be measured, but also a light waveform characteristic history 
can be derived by means of signal processing. Thereby, the method 
according to the present invention may be used to keep continuously 
track of a light source. Incandescent illuminations can be 
distinguished from fluorescent and LED-based lights etc. Moreover, 
the presence of a cathode ray tube can be detected and even 
distinguished by their characteristic refresh rate and 
phosphorescence. That is, no alterations of the light sources have 
to be performed. Thereby^ the needs of a positioning device 
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according to the present invention may be reduced to make use of 
natural properties of environmental sources only. 
[00161 Environmental sources may moreover count apparatus 
emitting sonic signals, e.g.^_ a fan emitting a characteristic 
humming sounds or electromagnetic radiation descended from an 
electric motor or an alternator^ etc. 

[0017] Information is stored in the device according to the 
present invention where the information may be associated to a 
number of waveform characteristics. The information may be any kind 
of data such as instructions, user input, data pointers, etc. A 
waveform characteristic may be defined to be a calculation based 
upon a frequency and a waveform ofj_ e.g._,__ a sampled light source. 
The light characteristic may^ for example^ be a spectrum ana - l - y - s e 
analysis representative of the sampled signal. If a processed 
signal is periodic, a base frequency may typically be found. The 
found base frequency (the lowest valid signal frequency which 
represents the interval between the spectral bands which can be 
computed from the waveforms) may have relevance by comparing a set 
of signals. By knowing the base frequency, more efficient signal 
detection algorithms may be adapted to perform a signal comparison. 
[0018] By performing autocorrelation on a periodic signal, any 
undesirable signals within may be suppressed. This is a well-known 
technique to suppress and sometime even eliminate undesirable noise 
to get a clean measurement signal. A further technique for cleaning 
a signal, i.e.^ noise cancellation, is by averaging a signal over a 



PHNL020974-SS-RED-110407 .doc 6 



PHNL 020974 



number of periods. Thereby, not only noise will be reduced, but 
also any potential sample errors during signal capturing^ such as 
jitter, timing errors, etc.^. may be reduced significantly or 
eliminated. When a light intensity characteristic is calculated, it 
may be altered in amplitude, e.g.^ normalized, re-sampled, 
stretched in time, etc.^_ to achieve a uniform, storable and 
comparable characteristic stature. 

[0019] A base frequency of a digital sampled signal may be 
derived by use of Fast Fourier Transform (FFT) , which is generally 
known to be a stable and efficient method— i„„ but other methods may 
alternatively be applied according to the type of sampled data. 
Since a FFT calculation sometimes de— does not output an accurately 
and acceptable result, in this case the base frequency, the FFT 
output may be refined by using a method comprising interpolation. 
This refinement typically increases reliability to an acceptable 
level of confidence. 

[QQ2Q] After deriving a valid light intensity characteristic, a 
sample-by-sample comparison of this and a unique characteristic may 
be performed. The estimated characteristic typically consists of an 
averaged period of a discrete waveform. For comparison of two 
signals, it is often useful that the signals are phase aligned. 
Therefore^ it may be advantageous to phase shift one of the signals 
to obtain phase synchronization. For this purpose^ a ring buffer 
may be used. By rotating the buffer a requested number of samples^ 
the two samples may be phase aligned. Thereby^ a direct and simple 
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sample-by-sample comparison may be applied. The two waveforms may 
be compared with respect to an offset value and/or deviation 
magnitudes to accept a wider range of near identically waveforms. 
[0021] If an estimated waveform cannot be found acceptable 
accep t ab 1 v - i - den - t - i - ea - 1-1 - y -- -f - o - r - identical to any already known stored 
waveform, it may be decided to accept greater deviations or, if 
necessary, to store the new and incomparable waveform as a new 
unique light intensity characteristic. Thereby^, the number of 
recognizable and separate light intensity characteristics may be 
increased for future processing tasks. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[Q022] These and other aspects of the invention will be apparent 
from and elucidated with reference to the embodiments described 
hereinafter in conjunction with the drawings, in which: 

[QQ23] Fig. 1 illustrates an embodiment of the current invention 
for waveform detection, signal conversion and signal processing--.-^. 
[0024] Fig. 2 shows a waveform of light emitted by an 
incandescent lamp provided with 50 Hz AC™^ 

[0025] Fig. 3 shows a waveform of light emitted by a fluorescent 
lamp provided with 50 Hz AC— ± 

[0028] Fig. 4 shows a waveform of light emitted by a computer 
monitor with 76 Hz refresh rate— ± 
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[Q0271 Fig. 5 shows a waveform of light emitted by a computer 
monitor with 100 Hz refresh rate--- ; and 

[00281 Fig. 6 illustrates an embodiment of the current invention 
for light detection, signal conversion and signal processing with 
two independent light detection circuits. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
[0029] Fig. 1 illustrates an embodiment of the invention to 
identify an environmental source, in the following a light source. 
%%e — A p hototransistor (101) is operated with a bias voltage by -fefee 
a p ull-up resistor (106) in the linear region to pick up light 
emitted from ambient light sources. The phototransistor (101) 
output may be amplified (102) to feed th e A - / - D-een - v e- r - fr e- r - an ana 1 ocr - 
to-digital converter (ADC ) (103) . The current measured by the ADC 
(103) may be proportional to the light intensity as long as the 
light is not too bright. The- A digital signal p rocessing (DSP) 
device (104) may carry out computations for a signal-processing 
algorithm described in the following. Since most artificial light 
sources typically have operating frequencies of a few hundred 
Hertz, it is typically sufficient to sample the signal in the ADC 
(103) at a few thousand Hz. The workload for the algorithm in the 

processing de - v ic e DS P (104) is therefore moderate since signals of 

interest have a relative relatively low frequency. Thereby^ it is 
possible to make use of inexpensive components which further is 
preferred for consumer-oriented products. To obtain a 
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characteristic for a signal, it may be useful to identify a base 
frequency of the signal and^_ additionally^ a waveform thereof. The 
signal processing method in the DSP (104) used to derive a light 
intensity characteristic^ may therefore comprise the steps 
5 explained in the following. It is to be understood, that values in 
the following, such as the sample rate and sample length, etc.^ 
easily may be changed to fit a given embodiment. 
1) The input signal from the ADC may be a Pulse Code 

Modulated (PCM) signal sampled at 8 kHz. The signal is partitioned 

10 into non-overlapping frames of N = 2048 samples. Each sample is 
multiplied with a Gaussian window function to minimize spectral 
leakage. A Fast Fourier Transformation (FFT) is computed on the 
frame resulting in N spectral coefficients. Low and high frequency 
components (<10 Hz, >7 kHz) are removed by^_ e.g.^ a - baRd - - band-p ass 

15 filter since these parts of the signal do not contribute to the 

signal being recognized. The spectral coefficient of maximal power 
is located, which provides a coarse estimate of the base frequency. 
Thereby^ an indication of the expected frequency found in step 2 is 
to be found. 

20 2) The same input signal as used in step 1 is used to 

improve the base frequency estimation. An estimation of the 
frequency corresponds to an estimation of the period, here in 
number of samples. For each potential period T in the confidence 
interval estimated in step 1, the average power of x[k] - x[k-T] is 

25 computed, where x[0], x[N-l] are the samples of the frame. The 
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location T of the minimal power is located by^ e.g.^ second order 
interpolation. A frequency estimation like this is usually more 
accurate than a single sample interval by depending on choosing an 
appropriate size of the autocorrelation window. 

3) The accurate estimation of the signal period T is used to 
extract the waveform of the periodic signal. This is done by 
splitting the input signal into non-overlapping frames, the k-th 
frame starting at round (k*T) . The frames are averaged with a 
first-order low-pass filter resulting in an estimated waveform and 
a confidence interval for each position of the waveform. The low- 
pass filter used in this example is defined as y[n] = (1-a) y[n-l] 

+ a x [n] , a = 0 . 1 . It is important that step 2 returns a sub-sample 
accurate estimation of T, because otherwise^ the period would drift 
away and the averaging process would remove details of the 
waveform. By this averaging process^ unwanted noise^ e.g._^ flicker 
noise, thermal noise, etc.^_ may be minimized to approach a cleaner 
signal . 

4) The final processing step is to rotate the waveform 
within the frame such that it is positioned in a fixed relation to 
the period. For example, if the waveform is just only one peak^ it 
should always appear at the same position. To find a fixed 
reference position within the waveform, the first non-DC 
coefficient of the FFT of the signal is calculated. The phase of 
this complex number indicates the phase-shift by which the waveform 
should be rotated back. The result of this method is a very stable 



PHNL020974-SS-RED-110407 .doc 11 



PHNL 020974 



waveform within the frame since -i-s-- .it uses a global property of the 
waveform and not just a local feature such as the maximum. 
[00301 In a preferred embodiment of the present invention^ the 
algorithm reads a 8 kHz linear PCM sampled signal as input and 
outputs an estimation of the dominant frequency and waveform of the 
most powerful periodic signal rate at about 4 Hz^_ as the sampled 
signal is partitioned into non-overlapping frames of 2048 samples. 
[0031] The amplifier (102) may comprise means to avoid 
overloading of the ADC (103) by the input signal. If the received 
light is too intense.,., the amplifier gain or,, e.g..,.. a signal 
compressor may be adjusted to overcome this. Likewise, the sampled 
signal may be normalized in the DSP (104) upon signal comparison to 
preserve comparable amplitude levels. 

[QQ32] The DSP (104) preferably comprises a memory (107) for 
storing a number of calculated light intensity characteristics. It 
may be possible for the DSP (104) to compare two signal 
characteristics with a range of allowed deviation-ama-n^ . In a 
preferred embodiment, the device further comprise means for 
recording, i.e._^_ storing, a new calculated light characteristic, 
i waveform. 

[0033] Fig. 2 shows a waveform of light emitted by an 
incandescent lamp provided with 50 Hz AC. Since the current 
provided oscillates with 50 Hz, the light modulation will be 100 Hz 
with a near sinus-shaped waveform. If the sampling frequency is 8 
kHz like the above-mentioned embodiment and the window sampling 
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window is of a size of 2048 samples, an averaging of the sampled 
signals may be applied by^ for example^ 10 periods, which is often 
plentiful for a valid signal approximation even in a heavily noised 
environment. Non-periodic signals^ such as random noise^ may 
thereby be virtually eliminated. 

[0Q34] Fig. 3 shows a waveform of light emitted by a fluorescent 
lamp provided with 50 Hz AC. Likewise Similar to the incandescent 
lamp, the modulated light frequency will be around 100 Hz but not 
smooth-curved in the same way as in figure Fig. 2, though. By 
sample-by-sample comparison of the sample waveforms for £4r€fFig . 2 
and #i€ fFiq . 3_,„ respectively, a relative difference in the waveform 
shapes may be found. Thereby^ the DSP may conclude that the two 
light characteristics hardly o - r -- i - g - i - n - - o r i g i na t e f r om the same source 
of light. It may, however, be concluded that the two waveforms are 
acceptable identical if^_ for example^ no shape of more identical 
waveforms are stored. It is to be understood that the selection 
threshold may vary according to stored information. 
[00351 Fig. 4 shows a waveform of light emitted by a computer 
monitor with 76 Hz refresh rate. The refresh frequency can be 
easily detected as a pulse which having a shape d - e =i £>end - s - - dependent 
on the content of the display. Since the waveform length will be 
different from the 50 Hz supplied signals, a sample-by-sample 
comparison with the 76 Hz will not be necessary. By comparing the 
waveform lengths^, it will show that the signals belong to different 
categories (100 Hz and 76 Hz^ respectively) . 
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[Q0361 Fig. 5 shows a waveform of light emitted by a computer 
monitor with 100 Hz refresh rate. Again, first the sample length 
has to be compared with waveform lengths stored in memory. The 
monitor operating by 76 Hz may therefore not be categorized with 
the new 100 Hz monitor signal, as the 76 Hz signal may be longer in 
number of samples. However, the waveforms in #j^ Fig . 2 and -£±-a- Fiq- . 
3 may be categorized as possible identical waveforms in conjunction 
with the 100 Hz monitor signal. Next step may be the above- 
mentioned sample-by-sample comparison to unveil how closely the 
signals resemble. The comparing DSP algorithm may.,., e.g..,,. tolerate 
deviations of frequency, waveform data, etc.„._ to compensate for 
measuring and/ or calculation inaccuracies . 

[Q037] Fig. 6 shows another embodiment of the present invention, 
wherein the DSP (104) processes inputs from t - h e - -two light detecting 
circuits (108a, 108b) comprising pull-up resistor (106a, 106b) , 
phototransistor (101a, 101b), amplifier (102a, 102b), and ADC 
(103a, 103b) . By using two or more inputs, the relative orientation 
of a device may be determined in contrast to the use of only one 
light sensor. For this^_ it may be necessary to use detectors with 
different sensitivity characteristics. In contrast to a standard 
digital camera, this camera with just a few pixels is very fast in 
computing the direction and further, only sensitive to periodic 
light sources. A possible application for this is a pointing device 
that does not need a fixed reference as long as there are periodic 
light sources around. 
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[Q0381 There are several applications for the method according 
to the present invention to identify a w fingerprint " of a periodic 
light source, some of them described in the following: 

• "Been here before" : The identity of a light source 

5 provides information about the location of the light detector. In 
particular, mobile devices equipped with a detector can recognize 
that the user is now in a room where he or she has been before by 
inspecting the room lighting or CRT screen available. 

• "Remember this": As before, but the detector is 

10 explicitly trained to remember a certain light source by pressing a 
'record' -button. Then this source is uniquely identified among 
others. For example, a certain CRT can be found baek-- again . Or the 
light source has been specifically designed as a 'beacon', e.g.^ an 
infrared LED sending out a fixed bit___sequence repeated 

15 periodically. The mobile device remembers this particular signature 
as a reference point. 

• "Orientation Sensor with arbitrary Reference Point": 
Since the method of this invention allows fee— idenrfe^#y d den t i f v i nq an 
arbitrary periodic light source, it can be extended easily to 

20 locate the relative orientation of detector and light source. For 
this^ it may be necessary to have several detectors with different 
sensitivity characteristics. After the joint signal of the 
detectors is locked to a periodic light source, its direction-of - 
arrival can be computed from a comparison of the relative intensity 

25 for the detectors. In contrast to a standard digital camera, this 
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'camera with just a few pixels' is very fast in computing the 
direction and only sensitive to periodic light sources (natural or 
planted on purpose) . A possible application for this is a pointing 
device that does not need a fixed reference, as long as there are 
5 periodic light sources around . 

• "Suppress Periodic Interference" : As a completely 

different application, the method of this invention can be used to 
suppress the main periodic signal from the signal coming from a 
light detector. For example, it is known that TL-lamps interfere 

10 with remote controls for consumer applications. 

[0039] This is usually solved by modulating the remote control 
at about 3 0 kHz and applying a ha - nd— band-p as s filter to the 
intensity signal. However, the power of the interference can be 
much larger than the communication signal. The method of this 

15 invention allows to predict the periodic interference and subtract 
it from the light signal to obtain a cleaner communication signal. 
It is even possible to use the predicted signal to adjust the 
preamplifier of the light detector to avoid overloading the 
detector . 

20 • "Quality Control for Lamps": Another different 

application is the quality control of lamps, either during 
fabrication or during use. Most common types of lamps produce 
periodic light where the details of the waveform are characteristic 
for properties of the actual source. 
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[Q04Q1 For example, TL-lamps close to their end of life show a 
significantly higher amount of flicker and noise. In the 
development of this invention^ this deviation from nominal 
performance has shown clearly. Therefore^ it should be possible to 
5 use it for service and maintenance by detecting lamps that are 
likely to fail in the near future. Currently, we do not know the 
actual dependency of residual lifetime and light pattern. This is 
subject to further investigation if seen as promising. 
• "Triggering Digital Scopes": Yet another application 

10 involves the signal processing method of this invention, without 
the light sensor part. An important and difficult part of digital 
scopes (to show electric signals) is the generation of trigger 
impulses. The method of this invention allows producing stabile 
triggering for periodic signals. This is an extension to existing 

15 trigger methods based on local features of the signal like 'peak- 
trigger' etc. 

[QQ41] The uses of general-purpose microprocessors, instead of 
DSPs, are a viable option in some systems design. Although 
dedicated DSPs are well suited to handle signal-processing tasks in 
20 a system, most designs also require a microprocessor for other 

processing tasks such as route managing, etc. Integrating system 
functionality into one processor may be the best way to realize 
several common design objectives such as lowering the system part 
count, reducing power consumption, minimizing size, and lowering 
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cost, etc. Reducing the processor count to one also means fewer 
instruction sets and tool suites to be mastered. 
[0042] While the description above refers to particular 
embodiments of the present invention, it will be understood by 
5 someone skilled in the art that many of the details provided above 
are by way of example only, and modifications may be made without 
departing from the scope thereof. 

[0043] The accompanying claims are intended to cover such 
modifications as would fall within the true scope and spirit of the 

10 present invention. The disclosed embodiments are therefore to be 

considered in all respect as illustrative and not restrictive, the 
scope of the invention being indicated by the appended claims, 
rather than the foregoing description, and all changes come within 
the meaning and range of equivalency of the following claims are 

15 therefore intended to be embraced therein. 
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ABST R AC T-t - OF THE DISCLOSURE 

I%-i-s---4:ny^^ In a device 

for location positioning^ and more particul ar 1 v - -- r - e - I - a - t - es- -- t - e , in a 
system for identifying an environmental source emitting a base 
frequency and waveform signal— A , a sensor (101) records an 
environmental source (105) emitting a base frequency and waveform 
signal, the signal being amplified (102), digitized (103), 
processed and compared (104) with a stored unique waveform 
characteristic. On the basis of the comparison result (s), location 
positioning and/or a device orientation may be determined. The 
inv e n - fc^ - en ----- f - u - r^ 
m ^ d/i - ufa ---- eent - a4 ^ ^^ 
ffi -e- t - h - e - ek -- 
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